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Abstract. We study, in a global uniform manner, the quotient of the ring of poly- 
nomials in (. sets of n variables, by the ideal generated by diagonal quasi-invariant 
polynomials for general permutation groups W = G(r, n). We show that, for each such 
group W, there is an explicit universal symmetric function that gives the N -graded 
\^) ■ Hilbert series for these spaces. This function is universal in that its dependance on £ 

r-| only involves the number of variables it is calculated with. We also discuss the com- 

binatorial implications of the observed fact that it affords an expansion as a positive 
coefficient polynomial in the complete homogeneous symmetric functions. 
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1. Introduction 

For rank n classical families of finite complex reflection groups W, we contribute to the 
description of the diagonal co-quasi-invariant space Qw for W, in several (say £) sets of 
n variables. Here, the use of the term diagonal refers to the fact that W is considered as 
a diagonal subgroup of W £ , acting on the £ th -tensor power lZ n of the symmetric algebra 
of the defining representation of W . Instead of the usual one, the action considered 
here is the so-called Hivert-action. Invariant polynomials under this action are known as 
quasi-invariant s 1 (or quasi-symmetric for the symmetric group). Our space Q\J is simply 
the quotient oflZ n by the ideal generated by constant-term-free quasi-invariants for W. 



Under the same name, an entirely different notion has been considered in [7, 8]. However, the termi- 
nology of quasi-symmetric polynomials being well ingrained, it seems awkward to call their generalization 
to other reflection groups by any other name then quasi-invariant. 
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We show that the associated multigraded Hilbert series, denoted Q\J(qi, ■ ■ ■ ,qi) (which 
is symmetric in the qi), can be described in an uniform manner as a positive coefficient 
linear combination of Schur polynomials 

Qw{qi,---,qe) = ^2cpS ll (qi > ...,qt), (1.1) 

with the c M independent of £, and fj, running through a finite set of integer partitions 
that depend only on the group W. This a typical phenomena in many similar situations 
such as considered in [6]. It has the striking feature that we can give explicit formulas 
for the dimension of Q\^ for all £. To see why this is so striking, it may be worthwhile 
to recall that, for the entirely analogous context of diagonal co-invariant spaces (i.e. the 
one corresponding to the usual diagonal action of W on lZh), a large body of work has 
only recently settled the special case £ = 2, but that we know almost nothing yet for 
£>3. 



2. Our context 

A down to earth description of our context may be given as follows. Consider a £ x n 
matrix of variables X := (xij). For any fixed i (a row of X), we say that the variables 
Xii,Xj2) • • • -,%in form the 2 th set of variables. In some instances it is worth simplifying 
this notation, and write 

/a?i x 2 ■■■ x n \ 
yi V2 - - ■ Vn 

J\ — 

\Z\ Z 2 ■ ■ ■ Z n J 

Thus, x = x\, . . . , x n stands for the first set of variables, y = y±, . . . , y n for the second 
set, . . ., and z — Z\, . . . , z n for the last set. 

With the aim of certain describing polynomials in the variables X, we choose to denote 
by Xj the j th column of X, for 1 < j < n. We assume the same convention for any £ xn 
matrix of non-negative integers A. Moreover, if the A t are the columns of A, we write 

A = A X A 2 ■■■A n . 

We then consider the monomials 

l n 

Xf 3 : = Y[ x°y , as well as X A : = JJ xf 3 . 

%=1 j=l 

For the monomials X A , who clearly form a basis of space of polynomials 1Z n '■= Q[A], 
the corresponding degree vector. 



deg(X A ):=J2 A 

i 

lies in N . 



./• 
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Given r,n E N + , recall that the generalized symmetric group W = G(r,n) may be 
described as the group ofnxn matrices having exactly one non zero coefficient in each 
row and each column, which is a r th root of unity. One usually considers W as acting on 
polynomials in lZ n = Q[X] by replacement of the variables by the matrix X w. With 
this point of view, we may consider that W is generated by the transpositions Sj, which 
exchange columns j and j + 1 in X, together with s which multiplies the first column 
of X by a (chosen) primitive r th root of unity. These generators Sj satisfy the usual 
Coxeter relations for j > 1: 

s 2 = Id, (sj Sj+i) 3 = Id, and 

Sj Sk = SkSj, when \j — k\ > 1. 

For the special pseudo-reflection so, we have Sq = Id and (soSi) 2r = Id. This is the 
diagonal action which is considered for the "usual" definition of the diagonal co-invariant 
space for W (see [5]). Rather than this space, we consider a variant below. 

Our point of departure from the "classical" situation is to consider rather the diagonal 
quasi-invariant polynomials for W. For example, taking W = G(l, 3) (the symmetric 
group S3) and £ = 1, we have the quasi-invariant (or quasi-symmetric) polynomials: 

X1 + X2+X3, xi 2 + x 2 2 + x 3 2 , Xi 3 + X 2 3 + X 3 3 , 

XiX 2 +X1X3 +X2X3, XiX 2 2 + X1X3 2 + X2X3 2 , Xi 2 X 2 + Xi 2 X 3 +x 2 2 x 3 . 

For £ — 2, another §3-quasi-invariant is the polynomial 

yix 2 y2 + yix 3 y 3 + y2%m- 

The vector space of diagonally quasi invariant for W = G(r, n) is spanned by the mono- 
mial basis {M J 4}^ 6 g rn , which are indexed by r- composition-matrices. These are the 
positive integer entries £ x k matrices, 1 < k < n, having all column sums congruent 
to mod r, with no column sum actually vanishing. We say that we have an r-matrix 
if this last condition is dropped. The monomial quasi-invariant associated to such a 
r-composition-matrix is simply defined as 



M A ■= J2 yj 



YCX 



with Y running over all matrices obtained by selecting (in the order that they appear) 
k columns of X. We sometimes write M[A] for Ma(X). It is easy to check directly that 
this is indeed a basis. For example, we have 



M 



1 3 1 Y^ 2 3 

20 = 1^ Xa Za Xb Vb - 



i<b 



We simply denote by Jw (or often simply by J) the ideal generated by constant-term-free 
diagonally iy-quasi-invariant polynomials. 

We may now define our main object of study, which is the co-quasi-invariant space: 

Q§--=k^/j w . (2.1) 
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To better analyze the structure of this space, we need to consider the action of the general 
linear group GLi on TZ n , defined by 

(f-r)(X):=f(rX), for r e GL e . (2.2) 

U) 
Observing that the ideal J = Jw is invariant under this action, we conclude that Q\y 

inherits a GZ^-module structure. Since the ideal J is homogeneous for the vector-degree, 

(£) 
Q\y may be graded by this same vector-degree, i.e.: 



ei? = 0e 



WAi 



with Qw,d denoting the homogeneous component of degree d of Q\J- It follows that the 
associated Hilbert series, Q^(q), coincides with the character of Q\y as a GL^-module. 
To help the reader parse this statement, let us assume that B is a basis consisting of 
homogeneous elements of Q\y- This means that, for f(X) in B, we have 

f(qX)=c L d f(X), (2.3) 

where q stands for the diagonal matrix 

,-f, 

and q d := g 1 1 • • -g £ f . Thus, an homogeneous f(X) is an eigenvector of the linear trans- 
form q* sending f(x) to /(qX). Recall here that, by definition, the trace of q*, as a 
function of the q^ is the character of Q\J- Summing up, the Hilbert series of the space, 
defined by the expression 

Q$(q):=^ci ddim ( Q ^)> (2.4) 

coincides with the (also usual) definition of the character of the corresponding (polyno- 
mial) representation of GLg. 

The point of this last observation is that Q\J (q) is Schur-positive, since Schur functions 
s A j(q) appear as characters of irreducible representations of GL^. Indeed, the decomposi- 
tion into irreducibles of the polynomial GL^-representation Q\^ (q) gives a formula of the 
form (1.1), with \i running through all partitions for which the homogeneous component 
Qw,fj, is non- vanishing. For example, for the symmetric group, one finds the following 
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expressions for Q n := Q s (q) 



Qi = 1, 

Q 2 = l + si(q), 

Q 3 = l + 2 Sl (q) + 2s 2 (q), 

Q 4 = l + 3s 1 (q) + 5s 2 (q) + 2si 1 (q) + 5s 3 (q), 

Q 5 = l+4si(q) + 9s 2 (q) + 5sii(q) + 14s 3 (q) 

+10s 21 (q) + 14s 4 (q). 

These examples exhibit the announced striking "independence" with respect to £. 

Before going on with our discussion, let us introduce another GL^-module which is 
isomorphic (both as a GL r module and a H^-module) to the space Q\J- For each of 
the variables x%j G X, consider the partial derivation denoted by d Xij , or dij for short. 
For a polynomial f(X), we then denote by f(dx) the differential operator obtained by 
replacing the variables in X by the corresponding derivation in dx- The space S^/ 
of diagonally super-harmonic polynomials with respect to W^-quasi-invariants is simply 
defined to be the set of polynomial solutions g(X) of the system of partial differential 
equations 

f(d x )(g(X)) = 0, for f(X)eJ. (2.5) 

Evidently, we need only consider a generating set of J for these equations to characterize 
all solutions. The elementary proof (see [5]) that Q\J and S\J are isomorphic relies on the 
fact that there is a scalar product for which S^/ appears as the orthogonal complement 
of J w . 

Following our established conventions, iS^/(q) stands for the Hilbert series of the 
graded space S^/ ■ From the above discussion, this is equal to the Hilbert series Q\J(q). 
The advantage of working with SU is that we may present a basis in terms of explicit 



polynomials (which give canonical representatives for equivalence classes in Q 



w ■ 



To get a better feeling of how things work out, let us first consider the case W = S3 
and 1 = 2. We may then check that we have the following bases Bd for the various 
homogeneous components 7i 3 d of the space "H 3 = S\y . 

B$ = {1}, 

Sf = {-x 1+ x 2 ,-x 1+ x 3 }, 

B m = {-yi + 2/2, -yi + 2/3}, 

^20 = {- (xi - x 2 ) (xi - 2 x 3 + x 2 ) , 

- (x 1 - x s ) {xi - 2 x 2 + x 3 )}, 
#11 = {x 2 V2 - x x y 2 - x 3 y 3 + x x y 3 -yix 2 + yix 3 , 

x 2 y 3 - x 3 y 3 + x x yi - y x x 2 - x x y 2 + y 2 x 3 }, 
#0? = {- (2/1 - 2/2) (yi -2y 3 + y 2 ), 

-(2/1 -2/3) (2/1 ~2y 2 + y 3 )}. 
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(2) (2) 

Observe that we can calculate B Qk from B k( j by exchanging all X\ by the corresponding 
Vi- 

?(3) _ c(3) 



By contrast, for £ = 3, the space S% = S^ affords the following bases. For all d of 

•(3) ._ »(2) 
jko ■- °jk 



the form jkO, we may choose B jk0 := B- k . To get the bases for the other non- vanishing 



components of S\^ , we set B- ok equal to the set of polynomials obtained by exchanging 

the Hi by the corresponding Zi for all elements of B- k0 . In turn, we get B - k from B- ok , 
now exchanging the ^-variables for the y-variables. It can then be checked that there are 
no other non- vanishing component in T-L 3 . One may also use Theorem 3.1 to see this. 
Our point here is that we get the two Hilbert series 

nf\quq 2 ) = l + 2(q 1 + q2) + 2(q 2 l +q 2 2 + q 1 q 2 ) 
?4 3) (<?i, 03, 93) = 1 + 2 (<?i + q 2 + q 3 ) + 2 {q\ + ql + q] + q±q 2 + gi?3 + ^2^3) 
both taking the form %(q) = 1 + 2 Si(q) + 2 S2(q), as announced. 



3. General results 

Theorem 3.1. For any given complex reflection group W = G(r,n), the Hilbert series 
Q\J(c\) affords an expansion in terms of Schur functions, with positive integer coefficients 
that are independent of t, the sum being over the set of partitions of integers d: 

0<d<2rn-r-n, (3.1) 

and having at most n parts. 

To better underline one of the most important feature of this statement, we may 
consider that the symmetric function involved in these expressions are written in terms 
of infinitely many variables 

q = 91,92,53, ••• 

This makes formula (1.1) entirely independent of £. To get the Hilbert series in the special 
case of £ sets of n variables, we simply specialize this "universal" formula by setting all 
variables qk, for k > £, equal to zero. This process is made even more transparent by 
"removing the variables", writing s M (or h^) instead of s At (q) (or /i M (q)) 2 in (1.1). In 
other words, we consider f(qi,. ■ -,qi) as the evaluation, of a (variable free) symmetric 
functions /, inn the set of £ variables qi, . . . , q#. We may also drop the £ in Q\J- 

The following formula, for the case £ = 1, is shown to hold in [1]. Namely, for the 
group W = G(r,n), we have 

<w^->-K)"-££K"tV- (32) 



As in Macdonald [10], we write hk for the complete homogeneous symmetric functions. 
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In particular, for n = 2, we get 

Q w (q, 0, 0, . . .) = (1 + q + . . . + q r ~ 1 ) 2 (1 + <f )• 
Since hk(q, 0, 0, . . .) = q k , this is readily seen to be the specialization at 

q = «?,0,0, ... 
of the following "universal" formula (see [6]), for the groups W = G(r,2): 

o 

' r— 1 \ 7 — 1 r— 1 

J2 hk ) + J2( k+1 ^ K + k + 5Z ( r " fc ) kr-l+fc- (3.3) 

k fc=0 / fc=0 fc=l 

As such, it holds for the diagonal co-invariant space (under the classical action) which, 
in this very specific case, coincides with the space of diagonal co- quasi- invariant space. 

A nice feature of the expression given in (3.3) is its h-positivity: 

^a M /i M , with a M > 0. 

This appears to hold for many other reflection groups, in particular when W is a sym- 
metric group, leading us to state the following. 

Conjecture 3.2. For the symmetric group, the Hilbert series <2 n (q) is h-positive in 
degrees smaller than n/2. 

An immediate consequence of this conjecture is that <2 n (q) has to have a very specific 
form, since 

Q n (g,0,0,...) = ^o M ^(g,0,0,...) 

= f>^' 

k=0 v 7 



£? X(/3) ' (3.5) 



with (3 running over the set of Dyck paths 3 of height n, and x{P) taking as value the 
re-coordinate of the first point of the path at height n. The passage from (3.4) to (3.5) 
is classical. It follows that 

Proposition 3.3. Conjecture 3.2 implies that Q n (q) affords an expression of the form 

Qn(q) =<n/2 Yl KtfM)' (3- 6 ) 

P 

with (3 running over the set of all Dyck paths of height n, and fi((3) some partition of the 
integer x(fi)- Here =< n /2 stands for equality in degrees less or equal to n/2. 



3 See section 5 for more details. 



J.-C. AVAL AND F. BERGERON 



As of this writing, we do not have a rule for producing the partition //(/?) associated 
to f3, which would haver to be compatible with the actual values given in (4.4). 



4. Formulas for low degree components 

We discuss now how to get explicit polynomial formulas in the variable n for the coef- 
ficient of hp, when /i is a partition of a small enough integer. We restrict the discussion 
to the case W = S n , but much of it holds in generality. We exploit here the fact that low 
degree homogeneous components of the spaces lZ n and Qn®^ 8 ™ are isomorphic, where 
TZ^ S " stands for the ring of diagonal quasi-symmetric polynomials. This immediately 
implies that we have explicit formulas for the relevant homogeneous components of Q n , 
since we have the explicit expressions 

7^(q) = (1 + tf (q))», and ^ s "(q) = - \ (4.1) 

1 - ti (qj 

where H (q) := ^2 k>1 /ifc(q)- It follows that we may calculate the low degree terms of the 
Hilbert series Q n (q) 5 via the expansion 

(l + #(q)) n (l-#(q)) = H-(n-l)/m-(n-l)/i 2 + |n(n-3)/i? + (n-l)/i 3 

+ | n(n — l)(n — 5)hf + n(n — 3)h 1 h 2 + . . . 

(4.2) 
Observe that the coefficients for the various h^ in Q n (q) agree with those in the right- 
hand side of (4.2), whenever n > 5. This phenomenon seems to hold for n larger then 
twice the order of terms calculated. 

Let us write k(n) for the number of parts of a partition fi, and denote by 

df, := di\d 2 \ •••d n \ 

the product of the factorials of multiplicities of parts in /x. Here di is the multiplicity of 
the part i. We then easily calculate that the coefficient of /i M (q), in the right hand side 
of (4.2), can be written in the form 



{n)k(fi) ^^ {n)k(u) 



E ^. < 4 ' 3 > 



where the summation is over the set of partitions that can be obtained by removing one 
part of /i. As usual, we denote by (n)k the product 

{n)k '■= n(n — 1) • • • (n — k + 1). 

Another way of looking at all this is to say that the coefficient of a given h^ stabilizes to 
a positive valued polynomial in n, as n grows to be large enough. 
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Explicit values. Explicit calculations give the following /i-positive expressions, in the 
case of the symmetric group. 



Qx ~- 


= l 


Q 2 = 


= l + h, 


Q 3 = 


= l + 2/i! + 2/i 2 , 


Q 4 = 


= l + 3h 1 + 3h 2 + 2h 1 2 + 5h 3 , 


Q 5 = 


= 1 + 4 hi + 4 h 2 + 5 h 2 + 4 h 3 + 10 h x h 2 + 14 /i 4 , 


Qe ~- 


= 1 + 5 h\ + 5 h 2 + 9 /ii 2 + 5 ha + 18 h x h 2 + 5 /ii 3 



(4.4) 



+28Mi + 14/i 2 2 + 42/i 5 . 



From this it would be tempting (as we did in a first draft of this paper) to conjecture 
that Q n is always /i-positive, but (as shown by recent calculations of H. Blandin and 
F. Saliola) this fails at n — 7, indeed we get 

Q 7 = 1 + 6 /ii + 14 /ix 2 + 6 /i 2 + 14 /ix 3 + 28h 1 h 2 + Gh 3 (4.5) 

+42/i 2 /ii 2 + 14/i2 2 + 28/ii/i 3 + 6/i4 (4.6) 

+84/i 3 /i 2 + 84/i 4 /i 1 -36/i5 + 132/i 6 . (4.7) 

Observe the coefficient of h 5 . For the groups W = G(2, n), which is the hyperoctahedral 
group B n , we do have the /i-positive expressions 

Qg(2,2) = 1 + 2 h x + h 2 + h 2 + 2 h 3 + h A , 

Qg( 2 ,3) = 1 + 3 h + 2 h 2 + 3 h 2 + 3 h 3 + h 3 + 3 hh 2 

+6 h 3 hi + 2h 4 + 3 h x h± + 5 h 5 + 6 h 6 + 2 h 7 . 

Explaining when we do have /i-positivity is still somewhat mysterious. 



5. Colored quasi-symmetric polynomials 

In light of the results and conjecture considered above, we think it worthwhile to refor- 
mulate results obtained in [2] from this new perspective. Indeed, the relevant formulas 
take a new and much nicer format which gives indirect support to our conjecture, since 
the Hilbert series considered happen to be provably /i-positive. This was not noticed at 
the time of the writing of [2]. 

Let us consider the subspace of colored 4 quasi-symmetric polynomials of the space 
of diagonal S n -quasi-invariants (in the context of X being I x n matrix of variables). 
Contrary to our previous presentation, colored quasi-symmetric polynomials are not 
defined as invariants. They are rather described in terms of a basis, indexed by "colored 



These where coined to be the G(£, n)-quasi-symmetric polynomials (or even B-quasi-symmetric when 
= 2) in [2, 4], but this terminology leads to confusion in the present context. 



10 



J.-C. AVAL AND F. BERGERON 



C 2p 



composition" . Recall that colored compositions of length p are £ x p-matrices 

/Cn C12 • ■ ■ Ci p \ 
_ C 2 l C 22 • ■ ■ 

\Qi C(2 ■■■ c £p J 

with non negative entries, and such that the associated entries reading word (obtained 
by reading column by column from left to right, and each column from top to bottom) 
avoids the pattern of £ consecutive zeros. 

To each colored composition C, we associate a monomial colored quasi-symmetric 
functions by setting: 



M 



c 



En n 



X 






(5.1) 







l<i<£ l<k<p 


where the sum is over all choices of a ik such that 


a-ik < a i+ltk , when 1 < i < £, 


ai k < a ljk+1 , for 1 < k < p. 


For example, we have 


M 


1 3 
1 

2 


= Yl Xa Z b X c Vd- 



and 



a<b<c<d 

An example helps us point out the difference between diagonal § n - quasi- invariants and 
colored quasi-symmetric polynomials. For n = 3 and £ = 2, we have the three indepen- 
dent diagonal quasi-symmetric polynomials of degree 2: 



Z1Z/1 + x 2 y 2 + x 3 y 3 , 
xm + xiyz + x 2 y 3 , 
x 2 yi + x 3 y 1 +x 3 y 2 , 



and 



whereas we have only two 



and 



xryi + x 2 y 2 + x 3 y 3 + x x y 2 + xiy 3 + x 2 y 3 , 
x 2 yi + x 3 y x + x 3 y 2 , 

colored quasi-symmetric polynomials in same degree. 

We denote by K the ideal generated by constant-term-free colored quasi-symmetric 
polynomials assuming that the parameters n and £ are unambiguous from the context, 
and introduce the quotient of the ring of polynomials by the ideal K: 

C^:=K^/K. (5.2) 

The main result of [2] may be elegantly re-coined in terms of an /i-positive expansion 
for the Hilbert series of C n = Cn ■ This new formulation has the extra advantage that it 
has similarities with the formula that we would expect to find under the hypothesis that 
conjecture 3.2 holds. In order to state this reformulation, we need to recall some notions 
concerning dyck paths. Recall that such a path is a sequence 

P=P0,Pl,...,P2n 
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of points pi = (xi,yi) in N x N, with Xi < yi, po = (0,0), p2 n = (n,n), and such that 
either 

( Pi + (1,0) or, 

U + (0,1), 
for all i. We say that n is the height of (3, and that we have a horizontal step 

s t := (pi-x,pi), 

at level k > 1, if yi = k — jji+i- The set of Dyck paths is denoted by V n . To any given 
Dyck path /3, we associate the composition v(l3) obtained by counting the number of 
level k horizontal steps (ignoring the situation when this number is zero), for k < n. An 
example is given in Figure 1, for the Dyck path 

13 = (0,0), (0,1), (0,2), (1,2), (1,3), (1,4), (2, 4), (3, 4), (4, 4), 

(4, 5), (4, 6), (5, 6), (6, 6), (6, 7), (6, 8), (7, 8), (8, 8) 

With these notions at hand, we may now give our new formula. 



. 
















2 










3 




1 

1 




i / 




C ►- 



Figure 1. A Dyck path (3 with u((3) = 132. 



Proposition 5.1. The Hilbert series of the quotient C n is given by the formula: 

pev n 
whose dependence on £ is entirely encapsulated in the number of variables in q. 



(5.3) 



Observe that if we set all the g« equal to 1, we get a combinatorial expression which is 
interesting on its own: 



E n 

pev n keu(/3) 



k 



1 



'n+l\ n 



(£ + l)n 



(5.4) 
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in which one may consider £ as a variable, hence we actually get a polynomial identity . 
For integral values of £, equation (5.4) may be proven via a simple bijection on paths. 
Observe also that both spaces C n and Q n coincide when £ = 1. 



6. Proofs 

6.1. Theorem 3.1. Recall that we are asserting here that there exists a universal ex- 
pression for the Hilbert series of Qw of the form 

with the sum running over partitions /i of integers d < 2rn — r — n, each such partitions 
having at most n parts. This restriction on the number of parts follows from the fact 
that this holds for the whole space lZ n , of which Qw (or rather Sw) can be considered 
as a subspace. 

In order to prove inequality (3.1), we need to introduce some notations. The sum of 
all the entries a r-matrix A, divided by r, is an integer that we denote by w r (A). This 
is said to be the r-size of A. To avoid ambiguity, we avoid r-matrices having their last 
column vanishing. The number of column of such a r-matrix is its length. 

Given a r- vector V (a single-column r-matrix), there is a lexicographically largest 
r-matrix A(V) such that 

• all of the columns of A(V) are of r-size 1, 

• the sum of the columns of A(V) is V, 

• the columns of A(V) occur in decreasing lexicographic 6 order from left to right. 

We denote 6(V) the first column of A(V) , and set A(V) := V-9(V). For V tr = (2,3,4), 
we get 

(2 N 
A(V) =12 

V° 1 3 , 

hence 9(V) tr = (2, 10) and A(^) tr = (0,2,4). We now associate to any r-vector V the 
smallest set, denoted by S(V), of r-matrices that contains A(V) and that is closed under 
the operation that consists in taking sum of consecutive columns. For example, still with 
V tT = (2,3,4), we have 

S(V) := 




It is a well-known fact that the right-hand-side is actually a polynomial in £. 
Considering entries from top to bottom. 
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For two £-row matrices, A = A\ • • ■ A/- and B = B\ ■ ■ ■ Bj, the concatenation AB is the 
matrix having columns 

AB := A l ---A k B l ---B j . 

For a general r-composition matrix A = AxA^-.-Ak, we define S(A) to be the set 
obtained by all possible concatenation of matrices successively picked from each of the 

sets S(Ai). 

We now come to the definition of the polynomials G[A] := GL4](X) that are used 
to prove (3.1). These are indexed by trans r-matrices, which is to say r-matrices A = 
A\ A<i . . . Aft for which there exists 1 < j < k such that w r (Ai . . . Aj) > j. It is clear that 
any r-composition matrix is trans. Let W = G(r,n). 

Definition 6.1. To a trans r-matrix A, we associate the W -quasi-invariant polynomial, 
G[A] = Ga{X) recursively defined as follows. 

• If A is a r-composition, we set 

G A := J2 M B- 

B£S{A) 

• If not, there is a unique column decomposition of A as a concatenation 

A = BOVC, 

where B a r-matrix (say of length j), V is a non-zero r-vector, and C is a r- 
composition. We then set 

G[A] := G[B VC] - X-^2 G[BA{V) C]. 

It should be clear that when A = B VC is trans, then so are both BVC and BA(V)C . 
Thus, the family G[A] is well-defined by induction on the length of A. 

It is helpful to consider an explicit an example. With r = 2 and n = 4, we compute 
that 

^[0203] = ^ f [o23j _X 3 2/3G'[[]|[5] 

= G[l\]-x\G[l\]-x,y,{G[ll]-xlG[H]). 
Since 

G[l\] = M[l\]+M[ll\] + M[l\l]+M[ll\^ 

G[l\] = M[8S]+M[»1S], 

G[U] = m[28]+m[88§], 

G[°A] = M[§o], 
we finally get 

G [0 2 3] = x l vl x * vl + A x 3 vl y\ + A vl Xa y'l + x\ yl x A y\ - x\ yl y\. 
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Observe that the lexicographic order leading monomial of G [ (j \ % \ 1 is precisely 

^f0201^ 22 o 

X\ 0203 ) = x\y l 2 x^yl. 
This is shown to hold in full generality in the following proposition. 
Proposition 6.2. For any trans r-matrix A, the leading monomial of Ga(X) is X A . 

Proposition 6.2 is established through the next two lemmas. 
Lemma 6.3. For any r- composition matrix A, we have 

G 0A = G A (X_ 1 ), (6.2) 

writing X_i for the alphabet obtained from X by removing its first column of variables 

Proof. We write A = VC, with V the r-vector corresponding to the first column of A. 
In view of Definition 6.1, we have 

G vc = X e ^G A{v)c + G V c(X^) (6.3) 

which implies (6.2). □ 

Lemma 6.4. Let A be a r-matrix of length j, and D a r-composition matrix, then we 
have 

G AD {X) = X A G 0W (X) + (terms < lcx X A ). (6.4) 

Proof. If A is a r-composition, (6.4) is a direct consequence of Definition 6.1. If not, 
equation (6.4) is shown to hold by induction on the length of A. Consider the unique 
factorization 

A = BOVC 
with B is a r-matrix of length j, V a non- vanishing r-vector, and C is a r-composition. 
We use Definition 6.1 and Lemma 6.3 to calculate that 

^BOVCD — ^BVCD — -A <~JBA(V)CD 

= X B G 0JVCD - x 01 -^v)^X B G oiHV)CD + (terms < lcx X B ) 

= X B G Q 3+i VC d + (terms <i cx X B ) 

= X B G 0JVCD (X^) + (terms < lcx X B ) 

= X B0VC GV-dPCi) + (terms < lex X B0VC ) 

= X B0VC G 0PD + (terms < lex X B0VC ). 

□ 

Proof of Condition (3.1). The proof is now an easy consequence of the following two 
observations. 

• Any r-matrix A with w r (A) = n is trans. Thus any monomial X A with A a 
r-matrix and w r (A) = n is the leading monomial of in ideal generated by quasi- 
invariant polynomials for the group G(n,r). 
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Any monomial of total degree strictly greater than 2rn — r — n is the multiple 
of a monomial X A , with A a r-matrix and for which w r (A) = n. Since it is true 
for any monomial of such degree, any monomial of degree strictly greater than 
2rn — r — n lies in the ideal, whence (3.1). 

□ 



6.2. Colored polynomials. The main aim of this subsection is to prove Proposition 5.1. 
Let us first show that formula (5.4) holds for all positive integer values of £, hence it 
follows that we have a polynomial identity. Recall that an £-path is a finite sequence of 
points Pi = (xj, yi) in the plane such that p Q = (0, 0) and 

or, 
Pi+i 

We say that we have an £-Dyck path if the path satisfies the further condition that x» < y^ 
for all i. Let us denote by T> n the set of £-Dyck paths of height n£. It is well-known 
that £-Djck paths are enumerated by the Fuss- Catalan numbers: 

appearing as the right-hand side of (5.4). To relate this to the left-hand-side of (5.4), we 
consider £-colored Dyck paths of height n, which are simply height n Dyck path (3 whose 
horizontal steps, at levels k < n, have been colored by elements of the set {1, 2, . . . , £}. 
Here, we assume that the colors of steps on a same level are weakly increasing from left 
to right, according to the color order 1 < 2 < . . . < £. In other words, the coloring is a 
function 7, associating to each horizontal step Sj of f3, a color j(si), in such a manner 
that 

7(*<) <7(si+i)» 
if both S{ and Sj+i are horizontal steps, hence inevitably at the same level. Thus -^-colored 
Dyck paths are pairs (/?, 7), consisting of a path with its coloring. 

We establish formula (5.4) by building a bijection between ^-colored Dyck paths of 
height n, and £-Dyck paths of height n£. Given an ^-colored Dyck path (j3, 7), we denote 
by akj the number of level k horizontal steps of color j, and we iteratively construct a 
path 

$(/?, 7) = <?o, <?!•.., (6.6) 

using this data. Starting with q = (0, 0), and running through the a^'s as k goes from 
1 to n — 1 and j goes from 1 to £, we successively add to it 

• akj horizontal steps of length £, followed by 

• one vertical step (0, 1). 

One easily check that this indeed results in an £-Dyck path of height n £. 
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This transformation is illustrated in Figure 2 with {red, green} as color set (i.e.: £ = 2). 
It is easy to check that $ is indeed a bijection. □ 






v^r 




FIGURE 2. The transformation $. 

With the intention of giving a proof of Proposition 5.1, let us recall the following result 
of [2] which generalizes the main result of [3]. 

Lemma 6.5. A monomial basis of the quotient Cn is given by the monomials X A such 
that tt(A) is an £-Dyck path. 

This last statement uses the following "encoding" of monomials X A in terms of lattice 
paths. The lattice path tt(A) is obtained by applying the following construction to 
entries- reading- word w(A) of the £ x n exponent matrix A. Starting with the point 
(0, 0), for each entry a of w(A) we add a horizontal steps (£, 0), followed by one vertical 
step (0, 1). For instance, Figure 3 represents the path tt(A) associated to the monomial 

( 1 1 0^ 9 

XV02J = x l x 2 y I 2 y^ 

whose exponent matrix has entries-reading-word 101201, Observe that each horizontal 
step is of length two. One associates variables to each level, namely Xi at even level 
2 (i — 1), and yi at odd level 2i — 1. We then readout the monomial from the path by 
the simple device of associating as exponent of the variable of a level, the number of 
horizontal steps on that level. 



Proof of Proposition 5.1. For a given Dyck path (3, let us consider the set C((3) of 
^-Dyck path n such that there exists a coloring 7 with <J>(/3,7) = i\. In formula, 

C{0) = { it I 37 such that $(£,7) = vr}, 

with $ as in (6.6). If a^ is the number of horizontal steps at level k in /3, the choice of 
^-coloring is equivalent to the choice of a monomial 

„ a kl 



X kl X k2 



■r, 



CO-QUASI-INVARIANT SPACES 



17 



2/3 

x 3 

1)2 
X 2 

1)1 
Xl 



Figure 3. Example of ti(A) for i = 2. 

with cikj giving the number of steps getting to be colored j, hence a^ = Ofci + . . .+aa. The 
Hilbert series of the resulting set of monomial is h ak (q). Since there is independence in 
the choice of colorings at different levels, the Hilbert series of the monomials associated 
to £-Dyck paths in C(/3) is h v ^(q). The fact that $ is a bijection gives the proof of 
Proposition 5.1, in view of Lemma 6.5. □ 



7. Open problems 

The main remaining open question in all the above considerations is to find a explicit 
(even conjectural) candidate for partitions /i(/3), one for each Dyck path 0, which would 
explain the /i-positive expansion in Proposition 3.3. Naturally, similar questions may 
be stated whenever the universal Hilbert series Qw/(q), for a group W, happens to be 
/z-positive. As discussed in the paper, the resulting entirely combinatorial description of 
the universal Qw{°l) would give, in one compact formula, the GL^-action characters for 
all the spaces Q l w . 
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